Papers with pointwise mutual information
Human-like informative conversations: Better acknowledgements using conditional mutual information (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing chatbots generate responses that are non-specific w.r.t. one of the contexts, typically the conversational history. |
| Approach: | They propose to build a dialogue agent that can weave new factual content into conversations as naturally as humans. |
| Outcome: | The proposed method trades off pmi for pcmi_h and is preferred by humans for overall quality over the Max-PMI baseline 60% of the time. |
Pointwise Mutual Information as a Performance Gauge for Retrieval-Augmented Generation (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing methods to improve language models' performance do not exploit this phenomenon . |
| Approach: | They propose to use contextual information to select and construct prompts that improve model performance. |
| Outcome: | The proposed methods show that the mutual information between a context and a question is an effective gauge for language model performance. |
SUE: Sparsity-based Uncertainty Estimation via Sparse Dictionary Learning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to estimate uncertainty use predictive confidence, structural characteristics of representation space, or stochastic variation in model outputs. |
| Approach: | They propose a new uncertainty estimation framework based on sparse dictionary learning by identifying dictionary atoms associated with misclassified samples. |
| Outcome: | The proposed framework outperforms or matches existing methods on several NLU benchmarks and sentiment analysis benchmarks. |